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(54) Color image display system 

(57) An image data conversion apparatus (2) 
includes color correction units for correcting the differ- 
ence in color reproduction characteristic between pro- 
jectors (3A, 3B), bias correction units for correcting the 
bias so as to display partial color images on a predeter- 
mined set bias, data distribution units for distributing 
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Description 

[0001] The present invention relates to a color image display system and, more particularly, to a color image display 
system having an image data conversion apparatus which converts input image data into display color image data to 
5 synthetically display partial color images displayed by a plurality of partial color image display apparatuses as a color 
image of one frame. 

[0002] In recent years, color image display systems for synthesizing display images by a plurality of projectors and 
displaying one precise and large image have been proposed and put into practical use. 

[0003] More specifically, each system projects and displays partial color images on a screen using a plurality of pro- 
io jectors, thereby synthetically displaying a color image of one frame on the screen. 

[0004] In such a system for displaying a color image of one frame by synthesizing display images by a plurality of 
projectors, a pixel position shifts or reproduction luminance changes between display images by the projectors due to 
geometric distortion or luminance difference between the projectors. 

[0005] Additionally, since this system generally synthesizes the display images by the projectors by making them 
75 partially overlap, color misregistration occurs in the overlap region due to the adjustment error in each display image. 
[0006] Conventionally, to solve these problems, the geometric distortion is corrected by adjusting the projection 
position of each projector or correcting image data, and color misregistration is corrected by correcting image data in 
the overlap region between the display images by the projectors. 

[0007] However, according to examinations by the present inventors, only the above-described geometric distortion 
20 correction and color misregistration correction in the overlap region between the display images by the projectors are 
insufficient to finally synthetically display a color image of one frame with a satisfactory quality. 
[0008] It is an object of the present invention to provide a color image display system capable of synthetically dis- 
playing a plurality of partial color images as a color image of one frame with a satisfactory quality. 
[0009] In order to solve the above problems, according to the present invention, in a color image display system 
25 comprising a plurality of partial color image display means for, upon receiving display color image data, displaying par- 
tial color images to be synthetically displayed as a color image of one frame, and image data conversion means for con- 
verting input color image data into the display color image data to be input to the partial color image display means, the 
image data conversion means or partial color image display means is designed to have the following arrangement. 

30 (1) The image data conversion means comprises color correction means for correcting the difference in color repro- 
duction characteristic between the partial color image display means. With this color correction means, even when 
the plurality of partial color image display means have different color reproduction characteristics, displayed colors 
match in the entire color image synthetically displayed as one frame. Hence, discontinuous joints between the par- 
tial color images are eliminated, and a high-quality color image can be displayed as a whole. 

35 (2) The image data conversion means comprises correction means for correcting a bias of the input color image 
data so as to display the partial color images on a predetermined set bias in the plurality of partial color image dis- 
play means. When the correction means for correcting the bias is provided, a case wherein the display color image 
data input to the partial color image display means has a value smaller than the bias and cannot be reproduced is 
eliminated or reduced. 

40 (3) The image data conversion means comprises data distribution means for distributing the input color image data 
to the display color image data to be input to the partial color image display means so as to display, at a predeter- 
mined ratio in an overlap region, the partial color images contained in the overlap region between the partial color 
images displayed by the partial color image display means. With this data distribution means, even in the overlap 
region where the partial color images by the plurality of partial color image display means overlap, a desired color 

45 can be accurately displayed. 

(4) The image data conversion means comprises nonuniformity correction means for correcting a color nonuniform- 
ity in partial color image displayed by the partial color image display means. When the partial color image displayed 
by each partial color image display means is corrected by the color nonuniformity correction means, high-quality 
display is done in each partial color image, and also discontinuous boundaries between the partial color image due 

so to the color nonuniformity which changes in units of partial color image display means can be prevented. 

(5) The partial color image display means are designed to display the partial color images with display luminance 
lower in an overlap region between the partial color image displayed by one partial color image display means and 
the partial color image displayed by the other partial color image display means than in a remaining region. When 
each partial color image display means has such a design, an increase in bias in the overlap region can be elimi- 

55 nated or reduced. 

(6) As the partial color image display means in (1 ) to (5), a multi-primary-color display having at least four primary 
colors may be used whereby a wider color reproduction range can be attained. 
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[0010] This summary of the invention does not necessarily describe all necessary features so that the invention 
may also be a sub-combination of these described features. 

[001 1] The invention can be more fully understood from the following detailed description when taken in conjunction 
with the accompanying drawings, in which: 

FIG. 1 is a block diagram showing the schematic arrangement of a color image display system according to the first 
embodiment of the present invention; 

FIG. 2 is a block diagram showing the internal arrangement of an image data conversion apparatus of the first 
embodiment; 

FIG. 3 is a view showing a measurement system for measuring the color reproduction characteristics of projectors; 
FIG. 4 is a block diagram showing the internal arrangement of a color correction unit of the first embodiment; 
FIG . 5 is a view showing partial display images by the projectors and the bias distribution of the synthesized display 
images in the first embodiment; 

FIGS. 6A, 6B, and 6C are views showing examples of a set bias in the first embodiment; 

FIG. 7 is a view schematically showing the actual bias and image data, which are projected onto the white axis in 
the first embodiment; 

FIG. 8 is a view showing the distribution of distribution coefficients of data distribution units of the first embodiment; 
FIG. 9 is a block diagram showing the internal arrangement of an image data conversion apparatus according to 
the second embodiment of the present invention; 

FIG. 10 is a block diagram showing the schematic arrangement of a color image display system according to the 
third embodiment of the present invention; 

FIG. 1 1 is a block diagram showing the internal arrangement of an image data conversion apparatus of the third 
embodiment; 

FIG. 12 is a view showing the concept of gain/bias correction in the third embodiment; 

FIG. 13 is a block diagram showing the internal arrangement of an image data conversion apparatus according to 
the fourth embodiment of the present invention; 

FIG. 14 is a block diagram showing the internal arrangement of a color correction unit of the fourth embodiment; 
FIGS. 15A and 15B are views showing arrangement examples of projectors in the fourth embodiment; 
FIG. 1 6 is a view showing the transmittance distributions of ND filters installed in the projectors; 
FIG. 1 7 is a view showing the distribution of a synthetic bias by the projector having the ND filter with the transmit- 
tance distribution shown in FIG. 16; 

FIGS. 18A to 18D are views showing synthetic bias distributions; 

FIG. 1 9 is a view showing another arrangement example of the projector in the fourth embodiment; 
FIG. 20 is a view showing still another arrangement example of the projector in the fourth embodiment; 
FIG. 21 is a view showing still another arrangement example of the projector in the fourth embodiment; 
FIG. 22 is a view showing still another arrangement example of the projector in the fourth embodiment; and 
FIG. 23 is a view showing another distribution of distribution coefficients of a data distribution unit. 

[0012] The embodiments of the present invention will be described below with reference to the accompanying 
drawing. 

(First Embodiment) 

[0013] FIG. 1 shows a color image display system according to the first embodiment of the present invention. This 
color image display system comprises an image input apparatus 1, image data conversion apparatus 2, projectors 3A 
and 3B, and screen 4. 

[0014] The image input apparatus 1 obtains, as input color image data, image data having three channels for RGB 
(red, green, and blue) per pixel, which is obtained by sensing an object using, e.g., a digital camera. 
[0015] The image input apparatus 1 has a linear sensitivity characteristic, and the input color image data is also lin- 
ear with respect to luminance. The input color image data obtained by the image input apparatus 1 is output to the 
image data conversion apparatus 2. 

[0016] The image data conversion apparatus 2 converts the input color image data from the image input apparatus 
1 into display color image data for the two projectors 3A and 3B serving as partial color image display means and out- 
puts the image data to the corresponding projectors 3A and 3B. 

[001 7] In this embodiment, each of the projectors 3A and 3B is a 3-primary-color projector using RGB colors, which 
projects and displays a partial color image on the screen 4 in accordance with the input display color image data. 
[0018] The partial color image displayed on the screen 4 by the projector 3A or 3B will also be referred to as a par- 
tial display image hereinafter. The partial display images are synthetically displayed on the screen 4 as a large color 
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image of one frame (also to be referred to as a synthesized display image hereinafter) as a whole. 
[0019] In this case, the partial display images by the projectors 3A and 3B partially overlap on the synthesized dis- 
play image on the screen 4, as shown in FIG. 1 . 

[0020] The image data conversion apparatus 2 will be described next in detail with reference to FIG. 2. 

5 [0021] The image data conversion apparatus 2 is constructed by color correction units 1 1 A and 1 1 B, geometrical 
correction units 12A and 12B, bias correction units 13A and 13B, data distribution units 14A and 14B, and gray scale 
correction units 15A and 15B, which are prepared in correspondence with the projectors 3A and 3B, respectively. 
[0022] The color correction units 1 1 A and 1 1 B, geometrical correction units 1 2A and 1 2B, bias correction units 1 3A 
and 13B, data distribution units 14A and 14B, and gray scale correction units 15A and 15B have identical structures. 

10 The arrangement of each part of the image data conversion apparatus 2 will be described below. 



[Color Correction Units 1 1 A and 1 1 B] 
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[0023] Input color image data (input signal values R, G, and B) within image regions displayable by the projectors 
3A and 3B are input from the image input apparatus 1 to the color correction units 1 1 A and 1 1 B. 
[0024] The input color image data do not depend on the characteristics of the projectors 3A and 3B. The signal val- 
ues R, G, and B of these input image data are converted into unique signal values (called display signal values) suitable 
to display by the projectors 3A and 3B by the color correction units 1 1 A and 1 1 B in accordance with the cotor reproduc- 
tion characteristics of the projectors 3A and 3B, respectively. 

[0025] FIG. 3 shows a measurement system for measuring the color reproduction characteristics of projectors 3A 
and 3B. On the basis of color image data output from an image output apparatus 5, single-color images of R (red), G 
(green), and B (blue) are projected onto the screen 4 by the projectors 3A and 3B. 

[0026] XYZ tristimulus values in the maximum light emission of these single-color images are measured from a 
patch image 6 on the screen 4 by a measurement instrument such as a spectrophotometer 7, thereby obtaining the 
color reproduction characteristics of the projectors 3A and 3B. 

[0027] To measure the color reproduction characteristics, an image sensing apparatus such as a digital camera 
may be used. In this case, single-color images of R (red), G (green), and B (blue) are projected onto the screen 4 by 
the projectors 3A and 3B on the basis of color image data output from the image output apparatus 5, and the images 
in the maximum light emission of these single-color images are sensed by the image sensing apparatus to obtain signal 
values, thereby obtaining the color reproduction characteristics of the projectors 3A and 3B. 

[0028] The resultant color reproduction characteristics of the projectors 3A and 3B are supplied to the color correc- 
tion units 1 1 A and 1 1 B, respectively. Each of the color correction units 1 1 A and 1 1 B converts the signal values R, G, 
and B of the input color image data into signal values (display signal values) R', G', and B* of display color image data 
by linear conversion represented by 
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where X r , X g , and X b are X values in the maximum light emission by the signal values R\ G\ and B\ Y r , Y g , and Y b are 
Y values in the maximum light emission by the signal values R', G\ and B\ and Z p Zg, and Z b are Z values in the max- 
45 imum light emission by the signal values R\ G\ and B\ 

[0029] The color reproduction characteristics of the projectors 3A and 3B are represented by the X, Y, and Z values. 
Additionally, ay is an element of a matrix A for converting the input color image data R, G, and B into the XYZ tristimulus 
values. 

[0030] To measure the color reproduction characteristics, an image sensing apparatus may be used. In this case, 
so as described above, single-color images of R (red), G (green), and B (blue) are projected onto the screen 4 by the pro- 
jectors 3A and 3B on the basis of color image data output from the image output apparatus 5, and the images in the 
maximum light emission of these single-color images are sensed by the image sensing apparatus to obtain signal val- 
ues, thereby obtaining the color reproduction characteristics of the projectors 3A and 3B. 

[0031 ] The resultant color reproduction characteristics of the projectors 3A and 3B are supplied to the color correc- 
55 tion units 1 1 A and 1 1 B, respectively. Each of the color correction units 1 1 A and 1 1 B converts the signal values R, G, 
and B of the input color image data into signal values (display signal values) R\ G\ and B 1 of display color image data 
by linear conversion represented by 
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where ay is an element of the matrix A for converting the input color image data R, G, and B into the XYZ tristimuius 
values, X r , Y h and Z r are XYZ values in the maximum light emission of R (red), Xg, Y g , and Zg are XYZ values in the 
maximum light emission of G (green), and X b , Y b , and Z b are XYZ values in the maximum light emission of B (blue). 
These values are calculated by next equation on the basis of the signal values output from the image sensing appara- 
tus. 
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where a matrix M is a matrix (chromaticity conversion matrix) for converting image signal values S obtained by the 
image sensing apparatus into XYZ values, and a is the number of channels of the image sensing apparatus. 
[0032] The image signal value S is a signal value obtained by the image sensing apparatus. For example, an image 
signal value S f1 means the signal value of the first channel in the maximum light emission of R (red). The chromaticity 
conversion matrix M is obtained in advance on the basis of the input/output characteristics of the image sensing appa- 
ratus. 

[0033] As an image sensing apparatus, a TV camera, digital camera, or multiband camera having at least four 
channels can be used. In the above description, the images in the maximum light emission of the single-color images 
of RGB are sensed to acquire the color reproduction characteristics. However, an arbitrary color images may be used 
as long as they are combination of independent signal values. 

[0034] If the above-described chromaticity conversion matrix M is not obtained in advance, color correction of each 
projector is performed on the basis of next equation. 
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where ay is an element of a matrix A' for converting the input color image data R, G, and B into signal values in a 
desired RGB space. The value S is a signal value acquired by the image sensing apparatus. For example, a signal 
value S r1 means the signal value of the first channel in the maximum light emission of R (red). 
[0035] FIG, 4 shows the detailed arrangement of the color correction unit 11 A (11 B). The color correction unit 1 1 A 
(1 1 B) comprises a matrix calculation unit 21 , matrix data storage unit 22, and matrix conversion unit 23. 
[0036] The above-described matrix A and color reproduction characteristic of the projector 3A (3B) are measured 
or set in advance and input to the matrix calculation unit 21 . The matrix calculation unit 21 calculates a matrix for con- 
verting the signal values R, G, and B of the input color image data into the display signal values R\ G\ and B'. The 
matrix calculated by the matrix calculation unit 21 is stored in the matrix data storage unit 22. 

[0037] in conversion, the matrix conversion unit 23 reads out predetermined matrix data from the matrix data stor- 
age unit 22 and converts the signal values R, G, and B of the input color image data into the display signal values R\ 
G\ and B* on the basis of equation (1 ). The matrix data stored in the matrix data storage unit 22 changes depending on 
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a change in characteristics of the projector 3A (3B) or in units of image input apparatuses 1 . For this reason, the matrix 
data storage unit 22 can store/rewrite a plurality of data. Thus, the color correction units 1 1 A and 1 1 B correct the color 
reproduction characteristics of the projectors 3A and 3B, respectively. 

5 [Geometrical Correction Units 12A and 1 2B] 

[0038] The display signal values R\ G\ and B' output from the color correction units 1 1 A and 1 1 B are input to the 
geometrical correction units 12A and 12B. The geometrical correction units 12A and 12B perform geometrical correc- 
tion on the display signal values R\ G 1 , and B' such that the partial display images are projected at correct positions by 
10 the projectors 3A and 3B. 

[0039] Details of the geometrical correction are disclosed in Jpn. Pat. Appln. KOKAI Publication No. 9-326981, and 
a detailed description thereof will be omitted. 

[Bias Correction Units 13A and 13B] 

75 

[0040] The signal values R', G\ and B' of the color image data geometrically corrected by the geometrical correction 
units 12A and 12B are input to the bias correction units 13A and 13B. 

[0041] The bias correction units 13A and 13B set a set bias at each pixel position of the projectors 3A and 3B on 
the basis of actual bias data of the projectors 3A and 3B and position data of the overlap region between the partial 
20 display images by the projectors 3A and 3B, and corrects the biases of the signal values R', G\ and B* such that the 
partial display images are displayed on the set bias. The actual bias means a color displayed when all the RGB input 
signals to the projectors 3A and 3B are 0. 

[0042] FIG. 5 shows the biases of the projectors 3A and 3B (actual biases of the partial display images by the pro- 
jectors 3A and 3B) and an example of bias distribution of the synthetic bias of the projectors 3A and 3B (actual bias of 
25 the synthesized display image). FIGS. 6A to 6C show examples of a set bias. 

[0043] Referring to FIGS. 5 and 6A to 6C, the abscissa represents two-dimensional pixel positions (x,y), and the 
ordinate represents a three-dimensional color space C. 

[0044] Referring to FIG. 6A, a predetermined value equal to the maximum value of the actual bias of the entire dis- 
play screen of the projectors 3A and 3B is set as a set bias. 
30 [0045] Referring to FIG. 6B, near the center of the screen including the maximum value of the actual bias of the pro- 
jectors 3A and 3B, the set bias is set to be equal to the maximum value of the actual bias. The set bias smoothly 
decreases toward the periphery of the screen. 

[0046] The maximum value of the actual bias of the projectors 3A and 3B means a bias with which the projective 
vector of a predetermined color vector (e.g., white vector) is maximized. 
35 [0047] When image data is displayed with a distribution on the set bias shown in FIG. 6A or 6B, the image can be 
prevented from becoming dark and impossible to display because of the image data value smaller than the actual bias 
of the projectors 3A and 3B, or being clipped and displayed as an unnatural image. 

[0048] Referring to FIG. 6C, a set bias is obtained in units of pixel positions on the basis of the relationship between 
the actual bias in the entire display region of the projectors 3A and 3B and all image data input to the bias correction 
40 units 13A and 13B. 

[0049] More specifically, a set bias is set such that the difference vector in projective vector to white vector (white 
axis) between image data and actual bias (i.e., the difference in color projected onto the white axis between image data 
and actual bias) is maximized. FIG. 7 schematically shows the actual bias and image data, which are projected onto 
the white axis. 

45 [0050] Let B(x,y) be actual bias at each pixel position of the projectors 3A and 3B, l(x,y) be image data correspond- 
ing to each pixel position, and W be the white axis of the display image. Norms N B (x,y) and N|(x,y) of the projective vec- 
tors of the actual bias B(x,y) and image data l(x,y) onto the white axis W are given by 

N B (x,yMB{x,y)*wym (5) 

50 

N,(x,y) =(><*,/)• W)/m 

where • is inner product calculation, and jj g is the norm of a vector. A set bias is set as a vector in the direction of white 
axis W, which has a norm N w at a pixel position (x,y) at which the norm difference AN(x,y) = N B (x,y) - N ,(x,y) between 
55 the projective vectors is maximized, and is given by 

B s = N w W/m (6) 
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[0051] When a set bias is defined in units of pixel positions on the basis of the relationship between actual bias of 
the projectors 3A and 3B and image data input to the bias correction units 13A and 13B for actual display by the pro- 
jectors 3A and 3B, color misregistration by the set bias can be minimized. In addition, generation of image data that is 
darker than the projective value of the set bias to the white axis and therefore cannot be reproduced can be avoided. 
5 [0052] Let R 0 (x,y), G 0 (x f y), and B 0 (x,y) be display signal values corresponding to the actual bias at each pixel posi- 
tion of the projectors 3A and 3B, and R b (x,y), G b (x,y), and B b (x,y) be display signal values corresponding to the set bias. 
Display signal values R"(x,y), G"(x,y), and B"(x,y) after bias correction are given by 

R"(x,y) = R l (x, y) + R b (x, y) - R 0 (x, y) (7) 

10 

G"(x,y)=G\x,y)+G b (x,yyG 0 (x,y) 

B"(x > y)^B t (x f y) + B b {x t yyB 0 (x f y) 

15 [0053] Using tristimulus values X 0 (x,y), Y 0 (x,y), and Z 0 (x,y) of the actual bias, the display signal values R 0 (x,y), 
Go(x>y)» and B 0 (x,y) corresponding to the actual bias at each pixel position are given by 







X r X g X b 














r 0 (x,y) 






\z r z s z b J 







25 

[0054] In a similar way, using tristimulus values X b (x,y), Y b (x,y), and Z b (x,y), the display signal values R b (x,y), 
G b (x,y), and B b (x,y) corresponding to the set bias at each pixel position are given by 
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[0055] As the tristimulus values X 0 (x,y), Y 0 (x,y), and Zo(x,y) of the actual bias, XYZ values measured near the cen- 
tral portion of the projectors 3A and 3B are used, as in measuring the color reproduction characteristics of the projectors 
3A and 3B by the measurement system shown in FIG. 3. 
40 [0056] If the tristimulus values X 0 (x,y), Y 0 (x,y), and Z 0 (x,y) cannot be sufficiently accurately measured or fall out- 
side the luminance range measurable by the measurement instrument, X 0 (x,y) = Y 0 (x,y) = Z 0 (x,y) = 0 may be 
assumed. 

[0057] In the overlap region between the partial display images by the projectors 3A and 3B, XYZ values calculated 
as the sum of biases of the projectors 3A and 3B are used as the tristimulus values X 0 (x,y), Y 0 (x,y), and Z 0 (x,y). 
45 [0058] The actual bias and set bias of the projectors 3A and 3B are measured or set in advance and stored in the 
bias correction units 13A and 13B. A plurality of bias data are stored in accordance with a change in characteristics of 
the projectors 3A and 3B or the difference in set bias setting method and appropriately rewritten. 

[Data Distribution Units 14A and 14B] 

50 

[0059] The data distribution units 1 4A and 14B distribute the color image data after bias correction, which are input 
from the bias correction units 13A and 13B, to display color image data in units of pixels. 

[0060] In this image data distribution processing, the color image data input to the data distribution units 14A and 
14B are corrected and distributed to the output side such that, In the overlap region between the partial display images 
55 by the projectors 3A and 3B, the partial display images included in the overlap region are displayed at a predetermined 
ratio. 

[0061] More specifically, this data distribution processing is performed by multiplying the signal values of display 
color image data after bias correction by distribution coefficients K1 (x,y) and K2(x,y) so that the sum of display signal 
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values of display color image data to be input to the projectors 3A and 3B matches the sum of display signal values of 
original display color image data after bias correction, as shown in FIG. 8. 

[0062J Display signal values R'"1(x,y), G m 1(x,y), and B m 1 (x,y) of RGB colors at the pixel position (x,y), which are 
distributed to the projector 3A, are given by 

5 

rt'"1(x,y) = K1(x f y)fl"(x f y) (10) 

G'"1(x,y)=K1(x,y)G"(x,y) 

10 e ,n 1(x,y)=/C1(x,y)B"(x,y) 

[0063] Display signal values R'^x.y), G'^foy), and B ,n 2(x,y) of RGB colors at the pixel position (x,y), which are 
distributed to the projector 3B, are given by 

15 R l "2(x,y) = K2(x,y)fl"(x,y) (11) 

G ,tt 2(x,y)=K2(x,y)G u (x,y) 

8"'2(x f y) = K2(x,y)5"(x,y) 

20 

for 

K2(x,y)=1-K1(x,y) (12) 

25 [0064] The distribution coefficients K1 (x,y) and K2(x,y) are set to be smaller as the pixel position becomes far from 
the central position of the partial display images projected by the projectors 3A and 3B, as shown in FIG. 8. 
[0065] When a random number is added to one of the distribution coefficients K1 (x,y) and K2(x,y) set in the above- 
described way, and the distribution coefficients are re-calculated, the boundary between the partial display images in 
the overlap region due to a display error can be made unnoticeable. For example, the distribution coefficients K1(x,y) 

30 and K2(x,y) are re-calculated on the basis of 

K1 '(x,y)= K1 (x,y)+/?(/C1 (x,y)) (1 3) 

K2*(x,y) = l-KT(x,y) 

35 

K1'(x,y) and K2'(x,y) are re-calculated distribution coefficients. R(x) is a random number within the following range 

-X<fl(X)<1-X (14) 

40 [0066] The distribution coefficients K1 (x,y) and K2(x,y) before re-calculation are set in advance in the data distribu- 
tion units 14A and 14B. 

[0067] Processing from the color correction units 1 1 A and 1 1 B to the data distribution units 14A and 14B is sum- 
marized as follows. The input color image data R(x,y), G(x,y), and B(x,y) at the pixel position (x,y) are converted into 
display color image data R m (x,y), G ,n (x,y), and B"'(x,y) given by 
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G(x 9 y) 



G b (x,y) 
Mx,y)J 



G 0 (x 9 y) 
K B 9 (x,y)j 



(15) 



where K is the distribution coefficient K1 (x,y) or K2(x,y), or the re-calculated distribution coefficient K1 '(x.y) or K2'(x,y). 
[Gray Scale Correction Units 15A and 15B] 

[0068] The color image data R H, (x,y), G m (x,y), and B n, (x,y) output from the data distribution units 14A and 14B are 
input to the corresponding gray scale correction units 15A and 15B. The gray scale correction units 15A and 15B exe- 
cute gray scale correction on the color image data FT'fx.y), G'^x.y), and B m (x,y) output from the data distribution units 
14A and 14B to obtain RGB data R out , G out , and B out given by 

K^Yr (*"•) (16) 
* out -it (*'"> 

and output the RGB data R^, G out , and B out to the projectors 3A and 3B as final display color image data. 

[0069] In this case, y c * 1 (d) (c = r, g, b ) is gray scale correction data as an inverse function of output luminance with 

respect to an input signal value d whose maximum value is normalized to 1 . 

[0070] This gray scale correction data y c " 1 (d) is obtained by measuring the display luminance of the projectors 3A 
and 3B ranging from 0 to the maximum value of the input signal value of each of the RGB primary colors of the projec- 
tors 3A and 3B using the same measurement system as shown in FIG. 3, and stored in advance in the gray scale cor- 
rection units 15A and 15B. 

[0071] To acquire the gray scale correction data Y c ~ 1 (d), a spectrophotometer, colorimeter, luminance meter, or 
image sensing apparatus can be used. A method of acquiring gray scale correction data using a spectrophotometer, 
colorimeter, or luminance meter for spot light measurement is accurate but time-consuming. 

[0072] To the contrary, according to a method of acquiring gray scale correction data using an image sensing appa- 
ratus, when a gradation pattern is displayed and sensed, the gray scale correction data can be acquired by one sensing 
operation. In this case, when the shading of the image sensing apparatus is corrected, more accurate data can be 
acquired. 



(Second Embodiment) 



[0073] FIG. 9 shows the arrangement of an image data conversion apparatus 2 in a color image display system 
according to the second embodiment of the present invention. The arrangement of the second embodiment is the same 
as in the first embodiment except the image data conversion apparatus 2, and a detailed description thereof will be 
omitted. 

[0074] The image data conversion apparatus 2 of this embodiment comprises color correction units 1 1 A and 11 B, 
geometrical correction units 12A and 12B, bias correction units 16A and 16B, data distribution units 14A and 14B, non- 
uniformity correction units 17A and 17B, and gray scale correction units 15A and 15B, which are prepared in corre- 
spondence with projectors 3A and 3B shown in FIG. 1 . 

[0075] The arrangement of the image data conversion apparatus 2 of the second embodiment is the same as in the 
first embodiment except the bias correction units 1 6A and 1 6B and nonuniformity correction units 1 7A and 1 7B, and a 
detailed description thereof will be omitted. Only the bias correction units 16A and 16B and nonuniformity correction 
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units 1 7 A and 1 7B will be described. 



[Bias Correction Units 1 6A and 1 6B] 

5 [0076] In this embodiment, bias correction by the bias correction units 1 6A and 1 6B is performed using bias data 
measured in units of pixels, thereby coping with a case wherein the bias changes in units of pixels, unlike the first 
embodiment. 

[0077] Display signal values R 0 (x,y), G 0 (x,y), and B 0 (x,y) of RGB colors corresponding to actual bias at each pixel 
position, which are obtained on the basis of a color image signals R d (x,y), G d (x,y), and B d (x,y) obtained by sensing par- 
10 tial color images displayed by the projectors 3A and 3B with a digital camera, are given by 











-1 


'RA*>y)) 


75 


G 0 (x,y) 




G r G g G„ 




G d (**y) 




< B 0 (x,y) J 








Mx,y)j 



20 where Rg, G s , and B s (s = r, g, b) are R signal value, G signal value, and B signal value, respectively, which are 
obtained by sensing, with a digital camera, colors in the maximum light emission by s primary colors of the projectors 
3A and 3B. If the display signal values R 0 (x,y), G 0 (x,y), and B 0 (x,y) cannot be sufficiently accurately measured or cal- 
culated, R 0 (x,y) = G 0 (x,y)= B 0 (x,y) = 0 may be assumed. 



25 [Nonuniformity Correction Units 1 7A and 1 7B] 



[0078] This embodiment assumes that colors in the partial color images displayed by the projectors 3A and 3B are 
nonuniform due to the luminance difference between pixel positions. 

[0079] The luminance difference changes in units of RGB primary colors. Each primary color has a predetermined 
30 chromaticity value for each pixel position. In this case, image data R ,n (x,y), G'"(x,y), and B'"(x,y) corresponding to the 
light emission colors of the RGB primary colors and display color image data R^tay), G" H (x,y), and B' H, (x,y) have a rela- 
tion 



35 



r R m {x,yf 


f 


G m (x,y) 




JT{x t y)j 





0k t (x,y)0\G"Xx,y) 



■(18) 



40 



where kr(x,y), kg(x,y), and kb(x,y) are luminance nonuniformities of the RGB primary colors. Hence, the display color 
image data R m, (x,y), G""(x,y), and B""(x,y) after the luminance nonuniformities are corrected are given by 



45 



50 



55 



10 



EP1 058 168 A2 



10 



15 



20 



r K"(x,yp 




r \lk r {x,y)QQ^ 




G""{x,y) 




0\ik g {x,y)o\ 


! G'(x,y) 


{B""{x t y)j 




JOllk^y)) 


IB-fry); 



'\/k r (x,y)00YK(x,y)00^ 
Ol/k g (x,y)0 0K(x,y)0 
< 00Vk b (x,y)) < 00K{x t y)j 



'(x r x t x b X x 

Y,Y t Y h 

I 2 Z Zu 
l^V ' « * J 



G b {x,y) 
^(x.y)) 



G 0 (x,y) 
{B 0 (x,y) 



J) 



G(x,y) 



&\ a 3i a nA B ( x >yh 



•••(19) 



[0080] On the basis of equation (1 9), the nonunfformity correction units 1 7 A and 17B correct color nonuniformities 
by linear conversion using a color nonuniformity correction coefficient 1/kg(x,y) (s = r, g, b ) that changes in units of pixel 
25 positions and RGB primary colors. 

[0081] The value k^x.y) is obtained from RGB primary color signals at each pixel position, which are obtained by 
sensing, with a digital camera, the display images in the maximum light emission of the RGB primary colors of the pro- 
jectors 3A and 3B. 

[0082] A digital camera having a sensitivity characteristic linear with respect to luminance or signal values corrected 
30 to obtain linear sensing signals with respect to luminance are used. 



(Third Embodiment) 



[0083] FIG. 1 0A shows a color image display system according to the third embodiment of the present invention. 
35 [0084] This color image display system comprises an image input apparatus 31 , image data conversion apparatus 
32, multi-primary-color projectors 33A and 33B, and screen 34. 

[0085] The image input apparatus 31 inputs image data having three channels per pixel, which is obtained by sens- 
ing an object using, e.g., a digital camera. The image input apparatus 31 has a sensitivity characteristic linear with 
respect to luminance, and the input color image data is also linear with respect to luminance. 
40 [0086] The input color image data input by the image input apparatus 31 is output to the image data conversion 
apparatus 32. 

[0087] The image data conversion apparatus 32 converts the input color image data from the image input appara- 
tus 31 into display color image data for the two multi-primary-color projectors 33A and 33B serving as partial color 
image display means and outputs the image data to the corresponding multi-primary-color projectors 33A and 33B. 

45 [0088] Each of the multi-primary-color projectors 33A and 33B is, e.g., a 6-primary-color projector which projects 
and displays a partial color image on the screen 34 in accordance with 6-channe! display color image data input from 
the image data conversion apparatus 32. The partial color images are synthetically displayed on the screen 34 as a 
large color image of one frame. In this case, the partial display images by the projectors 33A and 33B partially overlap 
on the synthesized display image. 

so [0089] The image data conversion apparatus 32 will be described next in detail with respect to FIG. 1 1 . As shown 
in FIG. 1 1 , the image data conversion apparatus 32 comprises color correction units 41 A and 41 B, geometrical correc- 
tion units 42A and 42B, primary color luminance correction units 43A and 43B, and gray scale correction units 44A and 
44B, which are prepared in correspondence with the multi-primary-color projectors 33A and 33B. 



55 [Color Correction Units 41 A and 41 B] 

[0090] Input color image data within color regions displayable by the multi-primary-color projectors 33A and 33B 
are input from the image input apparatus 31 to the color correction units 41 A and 41 B. 



11 



EP 1 058 158 A2 



10 



[0091] The input color image data do not depend on the characteristics of the multi-primary-color projectors 33A 
and 33B. The input image data are converted into display color image data having 6-channel signal values unique to 
the multi-primary-color projectors 33A and 33B in accordance with the color reproduction characteristics of the multi- 
primary-color projectors 33A and 33B. 

[0092] The color reproduction characteristics of the multi-primary-color projectors 33A and 33B are obtained, using 
the measurement system shown in FIG. 3, by causing the multi-primary-coior projectors 33A and 33B to project single- 
color images of the six primary colors onto the screen 34 on the basis of 6-primary-color data (CI , C2, C3, C4, C5, and 
C6), and measuring XYZ tristimulus values in the maximum light emission of these single-color images using a meas- 
urement instrument such as a spectrophotometer. 

[0093] The obtained color reproduction characteristics are supplied to the color correction units 41 A and 41 B. Each 
of the color correction units 41 A and 41 B converts input color image data R, G, and B into display color image data (C1 , 
C2, C3, C4, C5, and C6) by 
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a n a n a n YiO 



(20) 



30 



35 



where m (l) jk (i = 1 to 24, j = 1 to 6, and k = 1 to 3) is an element of a matrix M determined by the color reproduction 
characteristics of the projectors 33A and 33B, and (i) is determined by the data values of the input color image data R, 
G, and B. 

[0094] When the multi-primary-color projectors 33A and 33B are 6-primary-color projectors, 24 matrices are 
switched in accordance with the region occupied by the data values of the input color image data R, G, and B. In addi- 
tion, ay is an element of a matrix A for converting the input color image data R, G, and B into XYZ values. 
[0095] A method of converting the XYZ values into multi-primary-coior image data signals as display color image 
data by the color correction units 41 A and 41 B is described in, e.g., Japanese Patent Application No. 11-048042 in 
detail. 

[0096] The matrices M and A are set or measured in advance and stored in the color correction units 41 A and 41 B. 



40 



45 



[Geometrical Correction Units 42A and 42B] 

[0097] The display color image data (C1 , C2, C3, C4, C5, and C6) corrected by the color correction units 41 A and 
41 B are input to the geometrical correction units 42A and 42B. 

[0098] The geometrical correction units 42A and 42B perform geometrical correction on the basis of the display 
color image data (C1, C2, C3, C4, C5, and C6) such that the partial display images are projected at correct positions 
by multi-primary-color projectors 33A and 33B. Details of the geometrical correction are disclosed in Jpn. Pat. Appln. 
KOKAI Publication No. 9-326981 , and a detailed description thereof will be omitted. 



[Primary Color Luminance Correction Units 43A and 43B (Gain/Bias Correction Means + Data Distribution Means + 
Nonuniformity Correction Means)] 

so [0099] The display signals (C1, C2, C3, C4, C5, and C6) which have undergone the geometrical correction by the 
geometrical correction units 42A and 42B are input to the primary color luminance correction units 43A and 43B. The 
primary color luminance correction units 43A and 43B perform processing corresponding to gain/bias correction, data 
distribution, and nonuniformity correction. The primary color luminance correction units 43A and 43B correct each pri- 
mary color signal Cj(x,y) (j = 1 to 6) of each pixel on the basis of equation (21) and outputs the signal to the gray scale 

55 correction units 44A and 44B. 



(21) 
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where aj(x,y) and pj(x,y) are correction coefficients used for all processes including bias correction, data distribution, 
and nonuniformity correction. 

[0100] On the same assumption as in the second embodiment, the signal value C'j(x,y) Q = 1 to 6) after gain/bias 
correction, data distribution, and nonuniformity correction is given by 

(C\x,y) 
C'2(x,y) 
C'3(x,y) 
C'Mx.y) 
C'5(x,y) 
C'6(x,y)) 
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[0101] Hence, ccj(x,y) and (3j(x,y) are calculated by 
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(24) 



When the signal value C j(x,y) (j = 1 to 6) is corrected by 



C'j(x,y)=a , j(x,y)C j (x,y)+fi j{ x,y) 
=p j (x l y)a j (x,y)C j {x,y)+$j{x,y) 



(25) 



such that the display signal values C'j(x,y) (j = 1 to 6) are {fa , p 2 , P3, p 4 , ps, and p 6 ) when the input color image data are 
(0, 0, 0) or (C' 1w C'gw, C'^, C' 4w , C' 5w , and C' 6w ) when the input color image data are (Rw, Gw, Bw), we have 



for 



Pj(x,y)=(C , jJx,y)-$ j (x,y))/(a;(x,y)C j „(x l y)) 
C' yW (x,y) = K(x,y)(C jw (x, y) ■ C j0 (x, y))l kj (x, y) 



(26) 



(27) 
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(28) 



[0102] As described above, when the correction coefficients a'j(x,y) and Pj(x,y) are set, and gain correction is done 
using the coefficient a'j(x,y), and bias correction is done using the coefficient Pj(x,y), a region where the input color 
image data has a smaller value than the bias and cannot be reproduced can be eliminated at a low-luminance portion, 
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and color misregistration by bias correction can be prevented to enable accurate color reproduction at a high-luminance 
portion. 

[0103] FIG. 12 shows the state wherein the color display image is accurately reproduced by gain correction and 
bias correction using the correction coefficients a'j(x,y) and f3j(x,y). 

[Gray Scale Correction Units 44A and 44B] 

.[0104] The arrangement of the gray scale correction units 44A and 44B is the same as described in the first embod- 
iment except that the number of correction data increases in correspondence with the six primary colors, and a detailed 
description thereof will be omitted. 



(Fourth Embodiment) 



[0105] A color image display system according to the fourth embodiment of the present invention will be described 
next with reference to FIGS. 1 3 and 1 4. The arrangement of the fourth embodiment is the same as that described in the 
first embodiment except projectors 3A and 3B and image data conversion apparatus 2, and a detailed description 
thereof will be omitted. 

[0106] In this embodiment, the image data conversion apparatus 2 comprises color correction units 51 A and 51 B 
and gray scale correction units 52A and 52B, which are prepared in correspondence with the projectors 3A and 3B, as 
shown in FIG. 13. 

[0107] The color correction unit 51 A (51 B) has not only the color correction function but also the bias correction and 
color nonuniformity correction functions and is constructed by a matrix correction unit 61 and bias correction unit 62, as 
shown in FIG. 14. 



[Matrix Correction Unit 61] 



[0108] Input color image data R(x,y), G(x,y), and B(x,y) within an image region displayable by the projectors 3A and 
3B are input from an image input apparatus 1 to the matrix correction unit 61. 

[0109] The input color image data R(x,y), G(x,y), and B(x,y) are converted, using a matrix M(x,y) corresponding to 
each pixel position (x,y), which is given by 



r >n x , (x,y)m l2 (x,y)m n (x,y) > 
Mi (x,y)m 32 (x, y)m 3} (x, y) > 



(29) 



into matrix correction data R'(x,y), G'(x,y), and B'(x,y) given by 
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(30) 



[0110] The matrix M(x,y) is calculated in advance by equation (31 ) and stored in the matrix correction unit 61 . 
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••(31) 

where tji(x,y) is an element of a matrix T(x,y) for nonuniformity correction at the pixel position (x,y), and the remaining 
notation is the same as in the first embodiment. The matrix T(x,y) is calculated by 
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(32) 



t2i(x,y)t 2 2(x,y)t 73 (x,y) 

J»(x,yyt 3J (x,y)t 33 (x,y)j 

'PixPnPn VY qu(x,y)q l2 (x,y)q l3 (x,y)^ 
PixPnPn <l2i(x,y)q n (x,y)q 33 (.x,y) 
KPuPnPn J Usi (x, y)q 31 (x, y)q 33 (x, y) } 



where qjj(x.y) is an element of a matrix Q(x,y) for converting a display image by an i signal of the projector at the pixel 
position (x,y) into a sensing signal of the jth channel, which is sensed by a digital camera. 

[01 1 1 ] The matrix Q(x,y) is calculated by equation (33) on the basis of image data obtained by sensing, with a dig- 
ital camera, an image of each color, which is displayed on the full screen while setting the input signals to the projectors 
3A and 3B as, e.g., signals 1 (255, 0, 0), 2 (0, 255, 0), and 3 (0, 0, 255). 
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••(33) 



where R k , G k , and B k (k = 1 to 3) are RGB signals obtained by sensing the kth display image, and pjj is an element of 
a matrix P for converting a partial color image displayed on the basis of the i signal of the projector at the standard posi- 
tion into an image signal of the jth channel, which is sensed by a digital camera. 

[0112] The matrix P is calculated by equation (34) on the basis of image data obtained by sensing, with a digital 
camera, an image of each color, which is displayed at the standard position while setting the input signals to the projec- 
tors 3A and 3B as, e.g., signals 1 (255, 0, 0), 2 (0, 255, 0), and 3 (0, 0, 255). 
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(34) 



where R k , G k , and B k (k = 1 to 3) are RGB signals obtained by sensing the kth display image. Arbitrary display images 
w by the projectors 3A and 3B can be used to calculate the matrix Q(x,y) and matrix P as far as they are displayed by input 
signals of three independent colors. 

[Bias Correction Unit 62] 

15 [0113] The matrix correction data R'fx.y), G'(x,y), and B'(x,y) are output to the bias correction unit 62. The bias cor- 
rection unit 62 subtracts, from the matrix correction data R'(x,y), G'(x,y), and B'(x,y), bias data N(x,y) corresponding to 
the pixel position (x,y), which is given by 
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N(x,y) = 



Sb(x,y)j 
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to calculate bias correction data R"(x,y), G"(x,y), and B"(x,y) given by 
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[0114] The bias data N(x t y) is calculated in advance by equation (37) and stored in the bias correction unit 62 
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[0115] The bias correction data R"(x,y) f G^x.y), and B"(x,y) output from the color correction units 51 A and 51 B are 
input to the gray scale correction units 52A and 52B. The arrangement of the gray scale correction units 52A and 52B 
is the same as that described in the first embodiment, and a detailed description thereof will be omitted. 

[Projectors 3A and 3B] 

[0116] A preferred arrangement of the projectors 3A and 3B used in this embodiment will be described next. The 
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projectors 3A and 3B are designed to make the display luminance of each partial display image lower in the overlap 
region between the partial display images by the projectors 3A and 3B than in the remaining region (the single display 
region of each partial display image). 

[0117] FIGS. 15A and 15B are views showing arrangement examples of the projectors 3A and 3B in the fourth 
5 embodiment. 

[0118] Each of the projectors 3A and 3B comprises a light source 71, a collimator lens 72, an ND filter 73A (73B), 
aluminum mirrors 74, 75, 78, and 79 as total reflection mirrors, half mirrors 76 and 77, a prism 80, an R liquid crystal 
panel 81 having an R filter, G liquid crystal panel 82 having a G filter, and B liquid crystal panel 83 having a B filter, which 
oppose the three light incident surfaces of the prism 80, and an optical system 84 including a projection lens. 
10 [0119] In the projector 3A, light from the light source 71 is coilimated through the collimator lens 72, transmitted 
through the ND filter 73A, reflected by the aluminum mirror 74, and then becomes incident on the half mirror 77, as 
shown in FIG. 1 5A. The half mirror 77 passes the red spectral component of the incident light and reflects the remaining 
spectra. 

[0120] A transmitted light component R1 from the half mirror 77 is reflected by the aluminum mirror 79 and trans- 
is mitted through the R liquid crystal panel 81 and then becomes incident on the prism 80. The reflected light components 
from the half mirror 77 become incident on the half mirror 76. 

[0121] The half mirror 76 reflects the green spectral component of the incident light and passes the blue spectral 

component. A reflected light component G1 from the half mirror 76 is transmitted through the G liquid crystal panel 82 

and becomes incident on the prism 80. 
20 [0122] A transmitted light component B1 from the half mirror 76 is sequentially reflected by the aluminum mirrors 

75 and 78 and transmitted through the B liquid crystal panel 83 and then becomes incident on the prism 80. 

[0123] The light components R1, G1, and B1 incident on the prism 80 are synthesized by the prism 80. The exit 

light is projected onto the screen 4 through the optical system 84 to display a partial color image. 

[0124] The projector 3B has the sane arrangement as that of the projector 3A except that the ND filter 73B is differ- 
25 ent from the ND filter 73A, as shown in FIG. 1 5B. 

[0125] FIG. 1 6 shows the transmittance distribution of the ND filter 73A in the projector 3A and that of the ND filter 

73B in the projector 3B. As shown in FIG. 1 6, the ND filters 73A and 73B have symmetric transmittance distributions. 

In the overlap region between the partial color images displayed by the projectors 3A and 3B, the transmittance 

decreases toward the edge. 

30 [0126] This makes it possible to reduce the increase in bias in the overlap region between the partial color images 
displayed by the projectors 3A and 3B and consequently avoid any increase in luminance in the overlap region relative 
to that in the single display region. 

[0127] FIG. 1 7 shows biases when the projectors 3A and 3B have no ND filters as a comparative example. If the 
projectors 3A and 3B have the same bias, the bias in the overlap region of the partial color images is twice that at the 
35 portion (single display region) where a single partial color image is displayed by the projector 3A or 3B. 

[0128] To the contrary, when the projectors 3A and 3B have the ND filters 73A and 73B having transmittance distri- 
butions shown in FIG. 18A, respectively, in accordance with this embodiment, the bias in the overlap region equals that 
in the single display region, as shown in FIG. 18A. 

[0129] When the projectors 3A and 3B have different biases, a bias distribution as shown in FIG. 18B is obtained 
40 by using ND filters having transmittances shown in FIG. 18B. If the transmittance corrected portion of the ND filters 
completely matches the overlap region of the partial display images, the discontinuity of the bias in the overlap region 
can be improved. 

[0130] If the transmittance corrected portion of the ND filters does not completely match the overlap region of the 
partial display images, and the overlap region is narrower than the transmittance corrected portion, the bias value 
45 becomes smaller than the ideal bias value, as shown in FIG. 1 8C. 

[0131] If the overlap region is wider than the transmittance corrected portion of the ND filters, the bias value 
becomes larger than the ideal bias value, as shown in FIG. 1 8D. 

[0132] As described above, even when the transmittance corrected portion of the ND filters and the overlap region 
of the partial display images do not completely match, the discontinuity of bias can be improved as compared to a case 
so without correction. 

[0133] Other arrangement examples of the projectors 3A and 3B will be described next with reference to FIGS. 1 9 
to 22. FIG. 1 9 shows the projector 3A, though this also applies to the projector 3B. 

[0134] A description will be made using the same reference numerals as in FIGS. 1 5A and 1 5B to denote the same 
parts in FIGS. 19 to 22. Referring to FIG. 15A, the ND filter 73A is arranged immediately behind the collimator lens 72. 
55 However, referring to FIG. 19, the ND filter 73A is inserted between the aluminum mirror 74 and the half mirror 77. 
Referring to FIG. 20, the ND filter 73A is inserted between the prism 80 and the optical system 84. Referring to FIG. 21 , 
three ND filters 73A are inserted between the prism 80 and the liquid crystal panels 81 , 82, and 83. 
[0135] In either example of the projectors shown in FIGS. 15A, 15B, and 19 to 21, the position of the ND filter can 
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be easily changed to set its direction such that the transmittance corrected portion corresponds to the overlap region 
between the partial display image by one projector having the ND filter and the partial display image by the other pro- 
jector. 

[0136] In the projector 3A shown In FIG. 22, a complete light-shielding plate 85 is located at an end portion between 
the prism 80 and the optical system 84, thereby dimming light corresponding to the overlap region of the partial display 
images by the projectors 3A and 3B. 

[0137] The embodiments of the present invention have been described above. However, the present invention is 
not limited to the above-described embodiments, and various changes and modifications can be made, as will be 
described below. 

(a) In the above embodiments, the input color image data is RGB image data input by the image input apparatus. 
However, the present invention is not limited to this, and XYZ image data or display signal values in the partial color 
image display means may be used. 

(b) In the above embodiments, a reflection-type projector is used as a partial color image display means. However, 
the present invention is not limited to this and can also be applied to a case wherein a display apparatus of another 
scheme, such as a rear (back projection type) projector, CRT display, or liquid crystal display, is used as the partial 
color image display means. 

(c) In the above embodiments, as a plurality of partial color image display means, two 3-primary-color projectors or 
two 6-primary-color projectors are used. However, the number of display means and the number of primary colors 
are not limited to specific values. For example, four 6-primary-color projectors may be used as the partial color 
image display means. 

(d) In the above embodiments, data used to correct the difference in color reproduction characteristic between the 
partial color image display means by the color correction means is obtained by measurement using a spectropho- 
tometer. Instead of the spectrophotometer, a digital camera may be used. In this case, the spectral sensitivity char- 
acteristic of the digital camera is represented by linear conversion of a color matching function, the data for 
correcting the difference in color reproduction characteristic between the display apparatuses can be accurately 
measured. In place of the spectrophotometer, a colorimeter or illuminance meter may be used. 

(e) In the above embodiments, the color correction means performs 3x3 matrix conversion or conversion from 
three primary colors into multiple primary colors. Instead, color conversion based on another scheme, e.g., conver- 
sion using a neural network, non-linear conversion including a term of higher order, conversion using a three- 
dimensional lookup table and interpolation may be executed. In any case, it is important that the color correction 
means uses data obtained by measuring the color reproduction characteristic data of each partial color image dis- 
play means. 

(f) In the above embodiments, as described in, e.g., the second embodiment, the distribution coefficients K1(x,y) 
and K2(x,y) having linear distributions as shown in FIG. 8 are used by the data distribution units 14A and 14B. How- 
ever, distribution coefficients having curve distributions as shown in FIG. 23, which spatially smoothly change in the 
overlap region between the partial display images by the projectors 3A and 3B as the partial color image display 
means, may be used. 

(g) In the above embodiments, in the projector 3A shown in FIG. 22, a complete light-shielding plate is located at 
an end portion between the prism and the optical system. However, the position of the light-shielding plate is not 
limited to this and may be between the optical system and the screen. 

[0138] Preferred implementations of the present invention disclosed in the above-described embodiments will be 
listed below. 

(1) A color image display system comprising: 

a plurality of partial color image display means for, upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of one frame; and 

image data conversion means for converting input color image data into the display color image data to be 
input to the partial color image display means, characterized in that 

the image data conversion means comprises color correction means for correcting the difference in color 
reproduction characteristic between the partial color image display means. 

(1 -1) A color image display system according to (1 ), characterized in that the color correction means performs cor- 
rection on the input color image data, including non-linear conversion. 

(1-2) A color image display system according to (1), characterized in that the color correction means comprises 
data acquisition means for acquiring data to be used to correct the color reproduction characteristics. 
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(1-3) A color image display system according to (1-2), characterized in that the data acquisition means comprises 
at least one of a spectrophotometer, colorimeter, image sensing means, and illuminance meter. 

[Effects] Even when the plurality of partial color image display means have different color reproduction charac- 
teristics, displayed colors match in the entire color image synthetically displayed as one frame. Hence, discontinu- 
5 ous joints between the partial color images are eliminated, and a high-quality color image can be displayed as a 
whole. 

(2) A color image display system comprising: 

a plurality of partial color image display means for, upon receiving display color image data, displaying partial 
w color images to be synthetically displayed as a color image of one frame; and 

an image data conversion means for converting input color image data into the display color image data to be 
input to the partial color image display means, characterized in that 

the image data conversion means comprises correction means for correcting a bias of the input color image 
data so as to display the partial color images on a predetermined set bias in the plurality of partial color image 
is display means. 

(2-1) A color image display system according to (2), characterized in that the set bias has a predetermined value. 
(2-2) A color image display system according to (2) or (2*1 ), characterized in that the set bias is one of actual biases 
of the partial color image display means, with which the projective vector to a predetermined color vector is maxi- 
20 mized. 

(2-3) A color image display system according to any one of (2), (2-1), and (2-2), characterized in that the set bias 
is calculated from all color image data input to the correction means and the bias in the total display region of the 
partial color image display means. 

(2-4) A color image display system according to any one of (2) to (2-3), characterized in that the set bias is calcu- 
25 lated on the basis of the difference vector in projective vector to a predetermined color vector between the color 

image data input to the correction means and the actual bias of the partial color image display means. 

(2-5) A color image display system according to any one of (2-2) to (2-4), characterized in that the predetermined 

color vector is the white vector of the partial color image displayed by the partial color image display means. 

(2-6) A color image display system according to (2), characterized in that the set bias spatially smoothly changes. 
30 (2-7) A color image display system according to any one of (2) to (2-6), characterized in that the correction means 

corrects the input image data so as to accurately reproduce a predetermined color (in the above example, (C' 1w , 
C f 3w» C J 4w» G'sw and CW) °* tne imaQe displayed by the partial color image display means. 

(2-8) A color image display system according to (2-7), characterized in that the correction means performs not only 

bias correction but also gain correction on the input color image data in units of primary colors. 
35 [Effects] A case wherein the display color image data input to the partial color image display means has a value 

smaller than the bias and cannot be reproduced is eliminated or reduced. 

In addition, when the set bias is calculated from the ail input color image data and all biases in the display 

region, the set bias can be minimized, and color misregistration by the set bias can be minimized. Furthermore, a 

case wherein the display color image data input to the partial color image display means has a value smaller than 
40 the bias and cannot be reproduced is eliminated or reduced. 

(3) A color image display system comprising: 

a plurality of partial color image display means for, upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of one frame; and 
45 image data conversion means for converting input color image data into the display color image data to be 

input to the partial color image display means, characterized in that 

the image data conversion means comprises data distribution means for distributing the input color image data 
to the display color image data to be input to the partial color image display means so as to display, at a pre- 
determined ratio in an overlap region, the partial color images contained in the overlap region between the par- 
50 tial color images displayed by the partial color image display means. 

(3-1 ) A color image display system according to (3), characterized in that the data distribution means distributes the 
input color image data to the display color image data to be input to the partial color image display means by reduc- 
ing the ratio toward an end of each partial color image displayed by the partial color image display means. 
55 (3-2) A color image display system according to (3) or (3-1), characterized in that the data distribution means dis- 
tributes the input color image data to the display color image data to be input to the partial color image display 
means using a random number. 

[Effects] Even in the overlap region where the partial color images displayed by the plurality of partial color 
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image display means overlap, a desired color can be accurately displayed. 

In addition, when the input color image data is distributed to the display color image data to be input to the par- 
tial color image display means by reducing the ratio toward an end of each partial color image, generation of dis- 
continuous joints due to the color difference between the partial color images by the partial color image display 
means can be relaxed. 

Furthermore, when the input color image data is distributed using a random number, generation of discontinu- 
ous joints due to the color difference between the partial color images by the partial color image display means can 
be more effectively relaxed. 

(4) A color image display system comprising: 

a plurality of partial color image display means for, upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of one frame; and 

image data conversion means for converting input color image data into the display color image data to be 
input to the partial color image display means, characterized in that 

the image data conversion means comprises nonuniformity correction means for correcting a color nonuni- 
form^ in partial color image displayed by the partial color image display means. 

(4-1) A color image display system according to (4), characterized in that the nonuniformity correction means cor- 
rects the color nonuniformity using image data sensed by a digital camera. 

(4-2) A color image display system according to (4) or (4-1), characterized in that the nonuniformity correction 
means corrects the color nonuniformity by correcting a luminance nonuniformity in each primary color of the partial 
color image displayed by the partial color image display means. 

(4-3) A color image display system according to any one of (4), (4-1), and (4-2), characterized In that the nonuni- 
formity correction means corrects the color nonuniformity by linear conversion using a color nonuniformity correc- 
tion coefficient which is obtained on the basis of primary color image data obtained by sensing a display image of 
each primary color with a digital camera. 

[Effects] When the partial color image displayed by each partial color image display means is corrected, high- 
quality display is done in each partial color image, and also discontinuous boundaries between the partial color 
images due to the color nonuniformity which changes in units of partial color image display means can be pre- 
vented. 

In addition, when the color nonuniformity is corrected using data obtained by sensing with a digital camera, 
nonuniformity correction can be performed in units of pixels. In this case, if the color nonuniformity is caused by a 
luminance nonuniformity of each primary color, data for color nonuniformity correction can be measured using a 
digital camera having an arbitrary spectral sensitivity characteristic. 

Furthermore, when the color nonuniformity is corrected by linear conversion using a color nonuniformity cor- 
rection coefficient obtained on the basis of primary color image data obtained by sensing the display image of each 
primary color with a digital camera, color nonuniformities with chromaticity values changing in units of primary 
colors can also be corrected. 

(5) A color image display system comprising: 

a plurality of partial color image display means for, upon receiving display color image data, displaying partial 
color images to be synthetically displayed as a color image of one frame; and 

image data conversion means for converting input color image data into the display color image data to be 
input to the partial color image display means, characterized in that 

the partial color image display means is designed to display the partial color images with display luminance 
lower in an overlap region between the partial color image displayed by one partial color image display means 
and the partial color image displayed by the other partial color image display means than in a remaining region. 

(5-1) A color image display system according to (5), characterized in that each partial color image display means 
has an ND filter whose transmittance becomes low in the overlap region. 

(5-2) A color image display system according to (5), characterized in that the partial color image display means low- 
ers the display luminance in the overlap region by eclipse by a light-shielding member inserted in the optical path. 
[Effects] When the partial color image display means are designed to lower the display luminance in the overlap 
region between the partial color images, an increase in bias in the overlap region can be eliminated or reduced. 

In this case, when an ND filter whose transmittance becomes low in the overlap region is used, such a partial 
color image display means for lowering the display luminance in the overlap region can be easily implemented. 

In addition, when the display luminance is lowered in the overlap region by eclipse by the light-shielding mem- 
ber inserted in the optical path, such a partial color image display means for lowering the display luminance in the 
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overlap region can be implemented at low cost. 

(6) A color image display system according to any one of (1) to (5), characterized in that each partial color image 
display means comprises a multi-primary-color display having at least four primary colors. 

[Effects] When a multi-primary-color display is used as the partial color image display means, a larger color 
5 reproduction region can be realized. 

[0139] As has been described above, according to the present invention, in the data conversion apparatus for con- 
verting input color image data into display color image data to be input to the partial color image display means, color 
correction, bias correction, data distribution, and color nonuniformity correction are performed, or the plurality of partial 
w color image display means are designed to lower the display luminance of each partial color image in the overlap region 
between the partial color images displayed by the partial color image display means. Thus, a plurality of partial color 
images can be synthetically displayed as a color image of one frame having a satisfactory quality. 

Claims 

75 

1 . A color image display system characterized by comprising: 

a plurality of partial color image display means for displaying partial color images to be synthetically displayed 
as a color image of one frame, on the basis of display color image data; and 
20 image data conversion means for converting input color image data into the display color image data on the 

basis of color reproduction characteristics of said plurality of partial color image display means. 

2. A system according to claim 1 , characterized in that said image data conversion means further comprises color 
reproduction characteristic acquisition means for acquiring the color reproduction characteristics of said plurality of 

25 partial color image display means. 

3. A system according to claim 2, characterized in that said color reproduction characteristic acquisition means com- 
prises at least one of a spectrophotometer, image sensing means, a colorimeter, and an illuminance meter. 

30 4. A system according to claim 1 , characterized in that each of said plurality of partial color image display means com- 
prises a multi-primary-color display having at least four primary colors. 

5. A system according to claim 1 , characterized in that said image data conversion means corrects a bias of the input 
color image data so as to display the partial color images on a predetermined set bias in said plurality of partial 

35 color image display means, thereby converting the input color image data into the display color image data. 

6. A system according to claim 1, characterized in that said image data conversion means converts the input coior 
image data into the display color image data so as to display, at a predetermined ratio in an overiap region, the par- 
tial color images contained in the overlap region between the partial color images displayed by said partial color 

40 image display means. 

7. A color image display system characterized by comprising: 

a plurality of partial color image display means for displaying partial color images to be synthetically displayed 
45 as a color image of one frame, on the basis of display color image data; and 

image data conversion means for correcting a bias of input color image data so as to display the partial color 
images on a predetermined set bias in said plurality of partial color image display means, thereby converting 
the input color image data into the display color image data. 

so 8. A system according to claim 7, characterized in that each of said plurality of partial color image display means com- 
prises a multi-primary-color display having at least four primary colors. 

9. A color image display system characterized by comprising: 

55 a plurality of partial color image display means for displaying partial color images to be synthetically displayed 

as a color image of one frame, on the basis of display color image data; and 

image data conversion means for converting input color image data into the display color image data so as to 
display, at a predetermined ratio in an overlap region, the partial color images contained in the overlap region 
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between the partial color images displayed by said partial color image display means. 

10. A system according to claim 9, characterized in that each of said plurality of partial color image display means com- 
prises a multi-primary-color display having at least four primary colors. 

11. A color image display system characterized by comprising: 

a plurality of partial color image display means for displaying partial color images to be synthetically displayed 
as a color image of one frame, on the basis of display color image data; and 

image data conversion means for converting input color image data into the display color image data so as to 
correct color nonuniformities in the partial color images displayed by said partial color image display means. 

12. A system according to claim 11, characterized in that each of said plurality of partial color image display means 
comprises a multi-primary-coior display having at least four primary colors. 

13. A color image display system characterized by comprising: 

a plurality of partial color image display means for displaying partial color images to be synthetically displayed 
as a color image of one frame, on the basis of display color image data; and 

image data conversion means for converting input color image data into the display color image data to be 
input to said partial color image display means, 

wherein said partial color image display means display the partial color images with display luminance lower in 
an overlap region between the partial color image displayed by one partial color image display means and the 
partial color image displayed by the other partial color image display means than in a remaining region. 

14. A system according to claim 13, characterized in that each of said plurality of partial color image display means 
comprises a multi-primary-color display having at least four primary colors. 
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